Papers with neural programmer-interpreter approach
Improving Cross-Domain Low-Resource Text Generation through LLM Post-Editing: A Programmer-Interpreter Approach (2024.findings-eacl)
Copied to clipboard
| Challenge: | Large pre-trained language models such as GPT-3.5 and GPT-4 have gained significant attention in natural language research due to limited computational resources or inaccessible parameters. |
| Approach: | They propose a neural programmer-interpreter approach that preserves the domain generalization ability of LLMs while editing their output. |
| Outcome: | The proposed framework significantly improves GPT-3.5’s performance in logical form-to-text conversion and low-resource machine translation, surpassing other state-of-the-art (SOTA) LLM post-editing methods in cross-domain settings. |
EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing (P19-1)
Copied to clipboard
| Challenge: | Current sentence simplification systems are variants of sequence-to-sequence models adopted from machine translation. |
| Approach: | They propose a sentence simplification model that learns explicit edit operations via a neural programmer-interpreter approach. |
| Outcome: | The proposed model outperforms state-of-the-art models on three benchmark text simplification corpora in terms of SARI (+0.95 WikiLarge, +1.89 WikiSmall, -1.41 Newsela) |
Automatic Post-Editing of Machine Translation: A Neural Programmer-Interpreter Approach (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to inducing APE have suffered from over-correction, where the APE system tends to keep the machine translated text without any modification. |
| Approach: | They propose a neural programmer-interpreter approach to automated post-editing (APE) that mimics human perform post- editing using discrete edit operations . their model outperforms previous neural models for inducing PE programs on the WMT17 APE task for German-English up to +1 BLEU score and -0.7 TER scores. |
| Outcome: | The proposed model outperforms previous neural models for inducing PE programs on the WMT17 APE task for German-English up to +1 BLEU score and -0.7 TER scores. |